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SUMMARY 


A  series  of  pursuit  tracking  tasks  were  performed  incorporating  a 
transport  lag  in  the  contjrol  loop.  The  target  was  a  mixture  of  four  sine 
waves,  the  fastest  having  a  frequency  of  16  cycles  per  minute  at  full 
speed.  An  attempt  was  made  to  design  the  expeidments  so  that  they  would 
provide  data  applicable  to  remote  control  of  a  ground  vehicle  over  long 
transmission  distances. 

Three  programs  were  jrun.  In  each  the  time  lag  was  placed  between  the 
control  and  the  display.  In  the  first  program  a  velocity  control  vra.s  \ised 
and  the  operator  was  told  that  his  knob  controlled  a  vehicle,  the  problem 
represented  a  road,  and  he  was  to  drive  his  vehicle  along  the  road,  using 
the  delayed  vehicle  position  as  feedback  for  whatever  means  he  desired. 

The  objective  was  not  to  match  the  display  traces.  In  the  second  program, 
a  velocity  control  was  used,  and  the  operator  was  told  that  the  problem 
trace  represented  a  road  and  the  delayed  trace  represented  a  vehicle  and 
he  was  to  keep  them  together.  The  objective  was  to  match  display  traces. 
The  third  program  was  identical  with  the  first,  except  that  an  acceleration 
control  was  used  rather  than  a  velocity  control. 

Target  speeds  used  were  full  speed,  l/2  speed,  l/4  speed,  l/8  speed, 
and  l/l6  speed.  Time  lags  were  l/4  second,  l/2  second,  1  second,  1-1/2 
second,  2  second,  3  second,  and  6  seconds.  The  esqperimental  results  are 
presented  in  the  last  section  of  this  report. 


INTRODUCTION 


This  report  covers  a  portion  of  the  work  being  done  at  Stanford 
IMiversity  mder  NASA  contract  No,  NSG  111-61,  The  purpose  of  this  woric 
is  to  examine  the  effect  v5X)n  remotely  controlled  tasks  of  the  transport 
lag  due  to  long  transmission  distances.  The  subject  is  of  timely  interest 
because  of  the  increasing  nianber  of  such  situations  due  to  the  exploratioi 
of  space.  For  reasons  either  of  safety  or  of  economy,  machines  will 
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frequently  operate  at  extremely  large  distances  (hundreds  of  thousands  of 
miles)  fran  man.  However,  becavise  of  his  ability  to  recognize  patterns, 
adapt  to  unprogrammed  situations,  and  make  decisions  based  upon  incomplete 
data,  man  must  be  used  to  exert  some  degree  oi  control  over  these  machines. 
A  good  example  of  such  a  situation  is  NASA's  Froject  Prospector, 

A  literature  search  at  the  beginning  of  the  Stanford  project  showed 
little  useful  published  data  available.  It  therefore  became  necessary 
to  undertake  a  program  of  rather  exploratory  nature.  In  order  to  narrow 
the  problem  doxm  to  a  size  compatible  iri.th  the  researcher,  it  vras  decided 
to  concentrate  upon  distances  on  the  order  of  that  from  the  earth  to  the 
moon  (mean  of  239,000  miles,  ;m.th  an  accompanying  transmission  lag  of  1.28 
seconds  one  iray)  and  to  choose  the  remote-controlled  lunar  surface 
vehicle  as  a  typical  task. 

The  Stanford  project  consists  of  three  phases.  The  first  phase  has 
been  completed.  It  -was  a  series  of  tracking  experiments  incorporating  a 
time  delay  in  the  loop.  Tracking  i-ias  chosen  as  an  experimental  control 
task  because  of  the  ease  of  controlling  the  variables;  because  it  is 
extremely  representative  of  human  control  tasks;  and  because  of  the  great 
amount  of  work  idiich  has  been  done  on  tracking,  i-diich  rnght  be  useable  in 
later  generalization  of  the  experimental  results. 

The  second  phase  is  now  under  way.  It  ccnsists  of  a  series  of 
experiments  with  an  actual  remotely  controlled  vehicle,  so  as  to  simulate 
more  fully  the  situation  of  interest.  A  small,  versatile  vehicle  is 
being  ranotely  controlled,  using  television  as  the  primaiy  inforraation 
feedback  sensor. 

The  third  phase  vdll  be  a  correlation  of  the  results  of  the  two  series 
of  experiments  with  each  other,  lith  i-jhat  litile  theory  e:d.sts,  and  ^ith 
any  new  theory  X’duch  can  be  developed.  This  phase  will  not  be  actively 
pursued  until  the  first  tiro  are  complete.  Thc^  reason  for  this  is  that 
the  first  and  second  phases  represent  a  two-sided  experimental  attack 
upon  the  problem.  Phase  I  was  closely  controlled  and  limited  to  the  vari¬ 
ables  of  interest  only.  The  experimental  situation  tias  necessarily 
divorced  somevjhat  from  the  actual  remotely  controlled  vehicle  situation. 

The  advantages  of  such  experiments  are  ease  oi‘  parameter  variation  and 
straightfon-rardness  of  cause  and  effect  relationships.  However,  since  the 
human  operator  blithely  changes  his  transfer  function  for  different  tasks 
and  environments,  such  experiments  must  be  related  to  the  actual  situation. 

Phase  II  represents  the  actual  situation.  It  is  somewhat  cumber¬ 
some  because  of  the  many  variables  present.  Koirover,  since  it  is  a  close 
simulation  of  the  actual  ta.sk  of  remotely  controlling  a  lunar  roving 
vehicle  from  earth,  it  is  expected  to  yield  data  which  is  typical  of 
actual  man-machine  performance. 
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The  full  report  of  the  Stanford  work  x>ri.ll  not  bo  available  until 
approximately  December  1,  19^^1.  Hoirever,  because  of  the  interest  sho^ai 
in  the  program  and  because  of  the  impending  schedxxle  of  Project  Prospector, 
it  was  decided  that  the  results  of  the  tracking  experiments  of  Phase  I 
would  be  of  sufficient  interest  to  be  released  at  this  time. 

This  report  consists  of  a  description  of  the  tracking  experiments 
and  a  seid.es  of  curves  showing  the  results.  A  few  ijords  of  tjaming  are 
in  order  to  those  seeking  to  use  this  data.  It  is  not  moon-mobile  data. 
IJhen  data  from  Phase  II  becomes  available,  the  author  will  propose  moon- 

D  mobile  data.  Until  this  time,  it  is  requested  that  the  reader  keeij  in 

1  mind  that  this  report  is  the  Phase  I  data  only.  .\s  long  as  its  character 

2  is  realized  it  is  of  interest,  as  it  quantitatively  describes  the  effect 

1  of  transport  lags  on  a  control  loop  containing  the  human  operator 

1  performing  the  experimental  task. 


TPST  APPAPJITUS  A:ID  PROGPDUF.E 


Philosophy  of  Experiment 


The  situation  used  as  a  physical  model  was  the  remote  control  of  a 
ground  vehicle  vri-th  television  as  sole  sensory  input  to  the  operator. 

An  attempt  -was  made  to  approach  this  situation  mth  a  simple,  one¬ 
dimensional  tracking  experiment. 

At  this  point  it  vrould  be  wdse  to  briefly  ram  through  the  situation 
encountered  by  the  earth-based  operator  controlling  a  lunar  roving  vehicle 
if  he  has  nothing  at  his  disposal  save  vehicle-mo\jnted  television  and  a 
direct  radio  control  link.  A  signal  vAll  require  some  time  (approxiinately 
1.3  seconds  for  the  case  of  the  moon)  to  travel  between  the  vehicle  and 
the  operator.  Therefore,  at  any  time,  t,  the  situation  idiich  the  operator 
sees  is  not  vihat  is  presently  happening  on  the  moon,  but  rather  that  xdiich 
the  vehicle  saw  at  time  t  -  ©,  He  is  further  handicapped  as  aiiy  control 
input  he  might  malce  i-dll  not  reach  the  vehicle  until  time  t  +  0. 

It  seems  reasonable  that  in  order  to  make  a  control  input,  the 
operator  must  loiow  the  vehicle  situation  (position,  velocity,  accelera¬ 
tion,  etc.)  at  the  time  the  control  signal  vAll  affect  it.  Therefore, 
he  must  look  at  his  display,  which  represents  time  t  -  0 ,  and  somehow 
update  it  to  the  vehicle  situation  at  time  t  +  0.  The  operator  is  able  to 
do  this  with  some  degree  of  success,  by  using  his  recent  control  movements 
to  project  himself  ahead  along  the  vehicle  path.  Since  his  control 
signals  take  a  time  0  to  reach  the  moon,  the  vehicle  situation  which  he 
sees  in  his  scope  (time  t  -  0)  is  obviously  just  being  affected  by  a  signal 
xjhich  left  the  earth  at  time  t  -  2  0.  The  control  movements  sent  betx^een 
time  t  -  2©  and  t  -  0  will  affect  the  vehicle  between  times  t  -  0  and  t, 
so  if  they  are  integrated  and  added  onto  the  vehicle  situation  shotjn  on 
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the  scope,  the  vehicle  situation  can  be  updated  to  time  t.  Continuing  this 
process*  since  the  control  signals  sent  during  the  time  period  t  -  0  to  t 
will  affect  the  vehicle  between  times  t  and  t  +  0 ,  it  is  possible  to  update 
the  vehicle  situation  to  time  t  +  0 , 

Should  these  mental  gymnastics  be  possible  for  the  operator,  and 
should  the  vehicle  retain  a  one-to-one  relationship  with  the  f'ontrol 
input,  and  should  a  display  be  available  idiich  irould  make  position  plotting 
reasonably  simple  (such  as  a  Plan  Position  Indicator  display,  which 
presents  an  "aerial"  viei;  shov/ing  the  vehicle;  3^  the  center  of  the  screen) 
the  operator  might  be  able  to  know  the  vehicle’s  probable  location  v:ell 
enough  to  make  the  proper  control  movements  at  the  right  time.  At 
infinitesimal  speeds,  tliis  would  be  easy,  since  progress  during  the  time 
lag  (P-9)  would  bo  negligible.  However,  even  assuming  a  one-to-one 
relationship  betireen  control  input  and  vehicle  situation  (vihich  is  unlikely 
in  a  cross  country  ground  vehicle)  and  a  display  such  as  a  PPI  (which  is 
also  unlikely,  since  it  requires  a  complicat<;d  system  such  as  radar  or  an 
optical  system  r-iiich  would  allovr  a  picture  from  a  vantage  point  high 
above  the  vehicle)  the  process  vrauld  become  ruicreasingly  difficult  at 
increasing  vehicle  speeds  and  terrain  comple:d.ties. 

The  intention  of  this  series  of  experiments  vjas  to  attain  a  feeling 
for  the  deterioration  of  control  as  a  function  of  the  terrain-speed 
complexity  and  the  time  lag  0.  In  order  to  exclude  other  deteriorating 
factors,  the  operator  i\!as  given  a  one-to-one  control-vehicle  relationship 
and  a  clear  uncomplicated  display.  Quickening  and  aiding  vmsre  not 
considered  and  such  factors  as  lens  angle,  scan  rate,  and  camera  position 
were  ignored. 


Design  of  Experiment 


Below  is  a  simple  diagram  of  the  control  loop  xdiich  vre  are  interested 
in. 


Fig.  No.  1 
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The  net  requirement  on  the  operator  is  the  same,  as  far  as  updating 
his  display  to  match  his  control,  vdiether  the  time  lag  is  distributed  as 
shown  in  Fig,  No,  1,  whether  it  is  lumped  in  the  feedback  loop,  or 
whether  it  is  lumped  between  the  control  and  the  vehicle.  The  performance 
of  the  system  will  also  be  the  same,  except  for  being  displaced  in  time  by 
the  magnitude  of  the  lag.  Therefore,  for  the  sake  of  experimentation,  the 
lags  were  lumped  together  between  the  control  and  the  vehicle. 

Fig.  No.  1  may  appear  a  bit  strange  because  it  has  no  exterior  input. 
This  is  because  the  operator  must  derive  his  oxm  input  from  information 
gained  from  the  display.  An  automobile  driver  receives  his  input  from  his 
own  decisions  as  to  his  course  and  his  vievr  of  the  road  ahead,  A  remote 
vehicle  driver  functions  the  same  way,  except  that  with  a  time  lag  the 
process  is  complicated  by  the  previously  mentioned  necessity  of  "time 
matching"  the  view  ahead  ivith  the  control  signal. 

Ideally  this  series  of  e^qjeriments  irould  have  required  exactl3''  the 
same  mental  processes  from  the  operator  as  the  actual  situation.  Because 
of  the  difficulty  of  simulating  the  type  of  perspective  display  seen  from 
a  moving  vehicle,  this  was  not  accomplished.  Instead,  two  experimental 
situations  were  chosen  vdiich  would  utilize  a  conventional  tracking  display 
and  hopefulDy  xTOuld  bracket  the  act^^al  situation. 

The  actual  situation  i-rould  present  the  operator  with  the  vehicle- 
road  relationship  at  time  t  -  0 ,  enough  future  terrain  information  so 
that  he  could  select  rdrere  he  should  be  at  time  t  +  0 ,  and  the 
previously  mentioned  memory  of  control  movements  which  would  allov;  him 
to  project  his  vehicle  to  time  t  +  0,  IQiowing  tdiere  his  vehicle  probably 
was  and  xdiere  he  iranted  to  be,  he  could  control  accordingly  and  check 
his  progress  (belatedly)  by  looking  at  the  t  -  0  situation. 

One  of  the  experimental  situations  presented  the  operator  with 
vehicle  position  at  time  t  -  0,  and  rroad  position  at  time  t  +  0.  (This 
situation  will  be  referred  to  in  the  future  as  Type  I.)  As  in  the  actual 
situation,  the  operator  had  to  project  his  vehicle  position  ahead  to  time 
t  +0  in  order  to  compare  it  with  the  road  at  time  t  +  0,  However,  in  the 
experimental  situation  he  >ms  given  the  road  at  time  t  +  0  instead  of  being 
forced  to  derive  it  from  a  view  of  future  terrain.  This  irras  an  advantage. 

On  the  other  hand,  had  he  desired  to  check  his  progress  by  referring  to 
time  t  -  0,  it  x-isls  necessary  to  remember  the  iroad  position  at  time  t  -  0 . 
Tiiis  was  a  disadvantage  from  the  real  situation,  vriiere  the  t  -  0  road 
situation  vjas  given.  The  advantage  rroiild  intuitively  seem  to  outweigh 
the  disadvantage,  since  short  term  memory  was  being  substituted  for  the 
confusing  task  of  selecting  a  route  over  rough  terrain  from  out-of-date 
inf onnation .  It  was  therefore  suspected  that  this  experimental  situation 
TtKis  an  upper  limit  on  performance. 

The  other  experimental  situation  (Type  II)  presented  the  operator 
vjith  vehicle  and  road  position  at  time  t  —  0  (as  would  the  actual  situation) 
but  allovred  him  no  opportunity  at  all  to  see  the  road  ahead.  This  is  the 
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type  of  sitiiation  which  rdcht  be  enooimtered  shovild  the  roving  vehicle  be 
forced  to  navigate  a  naze  of  obstacles  tall  enough  to  block  the  vision  of 
the  television  canera.  Since  this  is  unlilcely  to  happen  to  the  extent 
sinxxilated  in  the  experiment,  the  e:q)eriniental  situation  i-as  more  difficult 
than  the  actual  one  would  be,  and  tjas  considered  a  loT-jer  limit  on 
performance , 


Description  of  Experiment 


Vehicle  driving  is  a  tracking  task  in  that  the  operator  is  continually 
attempting  to  follow  a  target  (the  road)  i-riLth  a  controlled  quantity 
(the  vehicle).  Tracking  can  be  either  of  txiio  forms  or  a  combination  of 
the  two.  The  first  form  is  compensatory,  in  ijhich  only  the  error  between 
the  target  and  the  controlled  quantity  is  displayed  to  the  operator.  He 
continually  attempts  to  minimize  this  error.  The  operator  is  handicapped 
because  he  cannot  tell  if  display  movement  is  due  to  his  action  or  to 
target  motion.  IJith  a  time  lag  in  the  loop  he  vrould  be  much  more  handi- 
capoed,  since  identification  of  inputs  would  be  even  more  difficult. 

Vehicle  driving  contains  a  fexr  elements  of  compensatory  tracking,  since 
the  operator  is  attempting  to  keep  the  target  (the  road)  centered  in  the 
display  (the  windshield) .  He  is  trying  to  minimize  the  error  beti-reen  the 
car  direction  and  the  road  direction. 

However,  driving  is  more  analogous  to  the  second  type  of  tracking. 

This  is  pursuit  tracking,  idiere  the  object  is  to  align  the  target  and  the 
controlled. quantity.  Both  are  presented  separately  on  the  display,  so 
that  the  operator  can  easily  see  and  identify  movements  in  either.  If  a 
car  could  be  steered  from  outside  (from  a  helicopter,  for  instance)  the 
control  would  be  of  pursrit  nature,  since  the  controlled  quantity  (the 
car)  and  the  target  (the  road)  corid  both  be  easily  seen.  Placing  the 
driver  inside  the  car  places  slightly  compensatory  qualities  upon  the 
control.  Hoiiiever,  the  driver  is  essentially  part  of  his  controlled 
quantity,  so  that  he  receives  many  cues  other  than  visual  as  to  its  notion. 
In  addition,  since  he  can  see  ahead  to  future  obstacles,  he  at  all  times 
knovre  idiat  his  target  is  doing.  Target  movement  is  easily  discernible 
from  movment  due  to  control  input.  Therefore,  pursrit  tracking  iras 
chosen  for  this  experiment. 

The  display  ijas  an  oscilloscope  tube,  showing  a  vertical  line  idiich 
extended  from  the  horizontal  center  line  to  the  top  of  the  scope,  and 
one  Tdiich  extended  from  the  horizontal  center  line  to  the  bottom  of  the 
scope.  The  bottom  line  was  driven  horizontally  by  the  problem  generator 
described  in  the  apparatus  section.  The  top  line  was  controllable  by 
the  subject.  Different  lags  corid  be  introduced  into  the  control  loop. 
Different  speeds  corid  be  given  to  the  taiget.  Different  responses  could 
be  given  to  the  lonob.  In  order  to  test  performance  vri.th  no  prediction 
possible  (Type  II),  the  subject  was  asked  to  match  the  ti-jo  lines.  In  order 
to  test  performance  with  complete  future  road  information  (lype  I),  the 
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subject  vra.s  asked  to  track  the  top  line,  using  the  bottom  line  as  delayed 
feedback  information  to  check  his  position.  Scoring  included  a  visual 
record  of  the  target  and  the  controlled  quantity,  the  percent  of  time  the 
controlled  quantity  'was  in  an  arbitraiy  target  zone,  and  the  integrated 
absolute  error. 


Apparatus 


Fig.  No.  2 

Fig.  Ho.  2  is  a  block  diagram  of  the  experimental  apparatus.  A 
description  of  each  block  follovjs; 

1.  Display,  The  display  vjas  a  Tektronix  model  51^  oscilloscope  I'd-th 
a  five  inch  P-ll  tube,  a  blue  filter,  and  a  red  graticule  light.  Room 
lighting  ^ra.s  lov;  during  the  experiments,  and  the  operator,  together  T^n.th 
the  display  and  the  control,  Tra.s  placed  at  some  distance  from  the  rest  of 
the  equipment  so  as  to  not  be  distracted. 
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2.  Operator,  A  compromise  had  to  be  made  between  a  large  number  of 
experimental  subjects,  with  correspondingly  greater  statistical  validity 
to  average  performance,  and  a  fexj  s\i)jects  and  a  greater  amount  of  experi¬ 
mental  runs.  Since  the  program  was  exploratory  in  nature,  and  since  many 
runs  rrere  desired,  a  minimum  of  subjects  vjas  used.  Tx^rO  subjects  were 
chosen,  both  between  the  ages  of  20  and  25,  well  coordinated,  •with 
uncorrected  20/20  ■vision,  and  eager  to  participate,  Bo'th  •were  excellent 
graduate  engineering  students,  with  knowledge  of  both  mechanical  and 
electrical  aspects . 

3.  Control.  Since  no  particular  attention  was  to  be  focused  upon 
the  effect  of  different  types  of  controls,  a  simple  spring-centered  loiob 
x-ra.s  chosen.  The  knob  ras  a-l/2  inches  in  diameter  and  could  be  turned 
through  45^  vd^th  a  torque  of  approximately  l/2  inch  pound.  A  very 
lightly  loaded  de'tent  -vras  pro^vided  so  that  there  would  be  no  question  of 
the  zero  location.  This  detent  was  found  to  be  extremely  useful  ■when  the 
system  was  being  operated  as  velocity  controlled  tracking,  as  it  gave  real¬ 
time  information  as  to  the  zero  velocity  position  of  •the  knob.  This 
information  cotild  not  be  seen  in  real  time  on  the  scope,  as  ■the  controlled 
quan^tity  was  fed'  back  through  the  delay.  VDien  •the  system  was  operated  as 

a  higher  order  tracking  experiment,  such  as  acceleration  controlled 
tracking,  the  detent  represented  zero  acceleration.  In  order  to  provide 
velocity  information,  a  neon  light  was  included  in  the  display  and  driven 
by  an  open  feedback  analogue  amplifier  fed  by  the  first  integration  of  the 
vol'tage  from  the  control  loiob.  Since  -this  integration  amounted  to  velocity, 
■the  light  would  go  out  >ihen  the  velocity  was  zero  and  give  the  operator 
an  indication  of  his  reversal  points.  This  additional  input  was  so  easy 
to  achieve,  and  such  an  obvious  aiding  de-vice  that  it  >jas  considered  basic 
in  "the  control  and  not  a  display  augmen-tation . 

4.  Vehicle  Analogue.  A  Dormer  model  30  analogue  computer  r^as  used 
to  prortde  vehicle-control  responses.  Because  of  the  flexibility  of  this 
computer,  it  rias  possible  -to  easily  change  and  experiment  vjith  various 
vehicle  dynamics,  control  knob  sensiti-vities,  and  so  on. 

5.  Vol-tage  Controlled  Oscillator,  A  Hallamore  model  0l6l  voltage 
controlled  sub-carrier  oscillator  -vjas  utilized  xdiich  produced  a  modulated 
Fl'I  carrier  cen-tering  around  7.35  Icllocycles, 

6.  Tape  Recorder  with  Delay  Loop.  An  A.-r^ex  model  307  instrumentation 
recorder  \jas  used.  The  recorder  had  bo-th  a  recording  and  a  playback  head 
s'tack  \diich  could  be  used  simul-baneously  for  monitoring  purposes.  For 
this  experiment  the  recorder  was  modified  by  constructing  a  -fcape  loop 
between  the  record  and  the  playback  heads.  Ey  adjusting  the  size  of  •this 
loop  and  -the  speed  of  -the  "tape  feed  capstan,  any  time  lag  in  the  region 
being  studied  could  be  at-tained  between  record  and  playback, 

7.  Discriminator.  A  Data-Control  Systems,  Inc,  llbdel  GFIX-2 
Discrimina-tor  was  utilized  to  convert  "the  FT-I  signal  from  "the  -tape  recorder 
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back  to  DC  The  oscillator-tape  recorder-discriniiiator  group  therefore 

of  ttao,  and  deUver  It  at  tho  end  of  that  t«e  an  ats 
original  state, 

8  Problem  Generator,  This  device  furnished  tl^  problem  for  the 
subject  to  track.  It  produced  four  sine  vraves  of  mascmum  fr  - 

quenoies  and  amplitudes  as  show  in  the  follovmi^  table. 


Resolver 

Freauency  (Cycles)  I-Iinute 

Amplitude 

No.  1 

16.0 

.4  volts 

No.  2 

12.6 

.6  volts 

No.  3 

10.1 

.6  volts 

No.  4 

3.8 

.9  volts 

Table  No.  1 


Anv  or  all  of  the  four  could  be  added  together  to  produce  one  wve.  Hhe 
Squencies  and  amplitudes  of  the  sine  naves  nere  chosen  so 

the°<n^tor  could  track  it,  yet  unpredictable  enough  so  that  it  could  not 
SsiS  S  neaSd."  Four  iy?e  CS-ll-AS-2  Clif^n  resol^^ 
toerfher  and  diiyen  through  a  ball-disc  integrator  ly  a  gear  The 

gSSSrbS^erSS  reso??eis  dictated  the  f^uen^  ratios  of  to  sine 
Tiaves  The  ball-disc  integrator  ws  used  as  a  variable  speed  _ 

that  the  resultinr^  wve  could  be  given  any  speed  betwen  zero  and  the  speed 
Snreient^  S  Sble  No.  1.  Either  the  rotor  or  the  stator  vrmd^s  of 
the  resolvers^could  be  excited  by  various  AC  voltages  and  the  outputs 
phase  sensitivelly  demodulated  to  give  sine  xjaves. 

9  Vibrator  The  vibrator  nas  a  converted  automobile  radio  vibrator 

used  L  a  s.dt=h  to  produce  the  to  traces  neoessaiy  for  ^s^ 

trackinr  The  unit  ws  driven  xAth  60  cycle  AC,  -vdiich  caused  it 

at  a  constant  120  c.n.s.  It  ws  then  synchronized  Tidth  tne  scope  svreep 

so  that  as  the  swep"  reached  the  midpoint  of  the  t^e  f^^® .  ^this 

would  swithc  from  one  information  channel  to  tne  other,  pi  ’ 

resulted  in  a  low  cost  dual  beam  scope  After  some  ^^3 

found  that  the  vibrator  produced  a  good  enough  square  viave  so  that  it  i;as 

able  to  switch  cleanly  and  regularly. 

10  Subtractor.  This  ws  merely  a  switching  box  which  would  ch^el 
the  difference  between  the  problem  voltage  and  the_  delayed  control 

to  the  scone  The  result  was  a  compensatory  traclcing  presentation.  Thi 
«s^ofSf  af  todootrtaatlon  tool,  but  as  yet  ha.s  f  ^ 

formal  axpertments .  (See  previous  discussion.)  The 

control  signal  were  normally  sidtched  to^the  vibrator,  as  show  in  Fig. 

Ho.  2,  so  that  pursuit  tracldng  resulted. 
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11.  Scoring  and  Recordins.  Scoring  and  recording  could  be  done 
either  of  two  Tjays,  As  the  switch  is  shovm  in  Fig.  Ho.  2,  tiiey  ire  re  done 
between  the  vehicle  and  tlie  pi'oblcsn.  This  was  Tyoc  I  track-in;^  as  the 
aim  iras  to  Iceep  the  real  time  veliicle  on  the  real  time  road,  using  the 
delayed  vehicle  situation  as  feedback.  If  th^  si-dtch  was  tlirown  to  the 
other  position,  scoring  iras  done  betireen  the  delayed  vehicle  position 
and  the  problem.  This  represented  Type  II  tracking.  In  either  case, 
visual  records  were  made  of  typical  runs  showing  both  the  problem  and  the 
associated  scored  quantity  (vehicle  or  delayed .vehicle) .  Two  model  3L  310 
Brush  Strain  dnalyrzers  iroro  used  as  amplifiers  for  a  tiro-channel  model 
BL  202  Brush  recorder.  In  addition,  two  error  measurements  iv-ere  made  for 
each  run  on  tlie  analogue  computer.  For  the  first,  the  ti.’O  quantities 
being  matched  i-jere  subtracted,  the  absolute  value  tal^en  of  the  difference, 
and  the  resulting  absolute  error  integrated  during  the  run.  The  second 
error  measurement  was  a  Time  on  Target  Score.  Hie  absolute  error  (positive) 
i.as  biased  witli  an  adjustable  DC  voltage  (negative),  and  the  result  fed 
to  an  analogue  amplifier  with  open  feedback  loop.  Since  these  amplifiers 
saturate  plus  or  minus  in  a  situation  such  as  this,  it  iras  possible  to 
drive  a  micropositioner  relay  through  a  diode  so  that  it  iras  closed  idicn 
the  error-plus-bias  iras  negative  and  open  when  the  en'or-plus-bias  i/as 
positive.  A  fixed  DC  voltage  was  then  integrated  through  this  relay. 

As  a  result  the  voltage  would  integrate  when  "ihe  error  t.^s  smaller  than 
the  absolute  value  of  the  bias  and  not  vjhen  tlie  error  was  larger.  TIic 
resulting  integral  over  a  run  vras  therefore  a  measure  of  the  tine  the 
svibject  had  tracked  with  his  absolute  error  smaller  than  the  present  value. 

All  four  sine  vraves  vrore  added  to  provide  the  target  vjave.  Although 
there  was  veiy  small  probability  of  all  vjaves  adding  in  phase,  the 
apparatus  ivas  adjusted  so  that  tliis  maximum  possible  target  value  iTOuld 
correspond  to  full  scale  deflection  on  the  recording  graph  and  1-7/S  inch 
deflection  on  the  scope,  which  •was  slightly  into  the  noticeably  nonlinear 
region  of  the  scope  face.  Tliis  prox’^ed  to  be  a  fortunate  choice  of  ranges, 
because  during  the  experimentation  the  problem  stayed  considerably  beloxf 
these  bounds  and  the  controlled  quantity  only  exceeded  them  in  obvious 
cases  of  out- of- control  operation. 


Conduct  of  Tests 


The  control-vehicle  dynamics  xrere  kept  aj;  simple  as  possible  in  order 
to  eliminate  extraneous  variables.  The  simplest  possible  type  of  control 
in  a  traclcing  task  is  zero  order,  or  position;  !  control.  In  this  type  of 
control,  a  loiob  position  xrauld  correspond  to  controlled  quantity 
position  on  the  target  face.  Hoirever,  this  was  considered  too  unrealistic. 
A  one-dimensional  representation  of  a  vehicle  can  be  most  easily  pictured 
by  imagining  oneself  standing  behind  a  vehicle  vjhich  moves  ax^ay  at  a 
constant  rate  along  a  gently  curving  road.  Ttie  third  dimension  is 
unimportant  as  long  as  the  road  is  level.  The  second  dimension  is  the 
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conponent  of  the  vehicle  velocity  vector  along  the  observer's  lino  of 
sight.  This  is  neglected  in  one-dimensional  tracking.  The  dimensioii 
ijhich  is  represented  upon  the  display  is  the  component  of  velocity  normal 
to  the  observer's  line  of  sight* 

A  position  control  would  correspond  to  a  vehicle  idiich  could  move 
normal  to  the  ope3pator's  line  of  sight  in  a  one-to-one  correspondence  ilth 
the  Imob.  Such  a  gromid  vehicle  x-rould  be  extremely  difficult  to  construct. 
The  simplest  realistic  veliicle  would  be  a  loi-ii-inertia  ''crab",  in  which 
steering  ijould  be  accomplished  by  tuiming  all  xAeels  to  the  desired 

D  direction.  The  direction  of  the  xjheels  would  have  a  one-to-one  relation 

1  with  the  control  Imob,  except  for  lags  caused  by  mechanical  and  ground 

2  friction  and  the  inertias  of  the  various  parts  of  the  steering  nechamisn. 

L  From  the  one-dimensional  vie't’iiDOint  discussed  above,  control  of  this  vehicle 

1  i-ro\ild  correspond  to  a  velocity  control  on  the  tracleing  experiment.  A 

position  of  the  control  Imob  'Liould  result  in  a  sideways  velocity.  Since 
this  is  the  simplest  possible  realistic  control  situation,  it  was 
adopted  as  a  beginning  point.  Inertias  were  minimized,  e::ccpt  for  a  very 
small  quantity  whicli  wa.s  included  to  give  the  operator  the  impression 
that  "something"  xas  being  controlled  and  to  smooth  out  unintentional 
dither.  Tlie  amount  of  inertia  las  not  large  enough  to  affect  the 
operator's  ability  to  track  the  target.  The  only  important  variables 
vjere  tine  lag  and  target  speed. 

Should  a  velrLcle  steer  lilce  a  conventional  automobile,  rather  than  a 
crab  veliicle,  a  higher  order  of  control  irould  be  involved.  If  inertias 
■were  again  neglected  and  the  front  wheel  position  assumed  to  correspond 
perfectly,  mth  the  control  !<nob  position,  a  displacement  of  the  Icnob  would 
result  in  a  displacement  of  the  ijheels,  wliich  would  result  in  a  circular 
path.  T'Jien  vieired  one  dimensionally,  'this  ■would  result  in  a  sinusoid, 
in  oixier  to  checl:  the  effects  of  such  a  higher-order  control,  it  was 
decided  to  test  an  acceleration  control  (Imob  displa,cement  causes  controlled 
quantity  to  accelerate)  as  w^cll  as  velocity  control. 

Control  sensiti^vities  trere  selected  bj'’  25rogrammigg  "the  computer  so 
that  knob  movement  never  exceeded  a  value  of  about  45  each  side  of  zero, 
but  yet  Tjas  large  enough  so  that  the  spring  loading  w^uld  pxovide  a 
"feel."  Sensitivities  irere  changed  for  each  target  speed,  so  that  the 
same  magnitude  of  Imob  movement  vrould  be  required.  Different  target  speeds 
therefore  corresponded  to  different  vehicle  speeds,  with  terrain  complex¬ 
ity  remaining  constant.  At  leijer  veliicle  speeds,  'the  effect  of  a  given 
tdieel  displacement  xrould  be  to  introduce  a  correspondingly.'"  loi.-er  normal 
velocity  vector. 

It  "was  desired  to  have  runs  short  enough  to  allow  several  to  be  made 
at  each  speed-lag  point  for  comparison.  It  was  also  necessaiy  to  have  runs 
long  enough  so  that  the  operator  couls  settle  doim  to  liis  normal  mode  of 
operation.  After  some  preliminary  ermerincii'tation,  a  run  length  of  five 
minutes  was  chosen,  of  irhich  the  last  three  minutes  were  scored. 
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The  problem  speeds  used  were  full  speed,  corresponding  to  the  sum  of 
the  sine  waves  shown  in  Table  No.  1,  half  speed,  quarter  speed,  eighth 
speed,  and  sixteenth  speed.  The  time  lags  were  zero,  one-quarter  second, 
one-half  second,  one  second,  one  and  one-half  seconds,  two  seconds,  three 
seconds,  and  six  seconds.  Six  seconds  corresponds  to  a  delay  in  each  side 
of  the  loop  of  three  seconds,  or  a  transmission  distance  of  560,000  miles. 

The  first  series  of  experiments  was  performed  using  a  velocity  control. 

Scoring  was  between  the  vehicle  (real  time)  and  the  problem  (real  time) 
with  both  the  problem  and  the  delayed  vehicle  position  presented  on  the 
display  (type  I).  The  operator  was  told  that  his  knob  controlled  a  vehicle  D 

and  the  problem  trace  represented  a  road.  He  vas  to  keep  his  vehicle  on  1 

the  road.  His  feedback  represented  the  position  of  his  vehicle  x  seconds  2 

in  the  past.  Both  operators  were  used  in  this  series  of  tests  and  all  1 

speeds  and  time  lags  were  given  to  both  operators.  The  time  lags  were  1 

presented  in  consecutive  increasing  order  with  all  speeds  being  run  at 
each  time  lag.  Learning  transfer  was  therefore  maximized. 

The  second  series  of  experiments  was  with  the  Type  H  velocity 
control.  Conduct  of  these  was  the  same  as  witli  the  TSq56  I  velocity  control 
except  that  scoring  was  between  the  problem  and  the  delayed  vehicle 
position,  and  the  subject  was  asked  to  align  tlxe  vehicle  line  on  the  scope 
with  the  target  line.  The  effect  of  this  was  to  simulate  driving  with 
the  lag  in  the  system  and  no  possible  prediction.  Only  one  subject  was 
used  for  this  series  of  tests.  The  reason  for  this  was  twofold.  In  the 
first  place,  this  test  represented  the  worst  possible  case  in  the  best 
possible  vehicle.  It  vra.s  not  of  the  limiting  character  that  either  the 
best  case  in  the  best  vehicle  or  the  worst  case  in  the  worst  vehicle  would 
be.  In  addition,  the  operators  performed  sufficiently  similarly  on  the 
first  set  of  tests  that  one  operator  could  be  considered  representative. 

The  third  series  was  performed  exactly  as  the  T^e  I  velocity  control 
series,  except  that  an  acceleration  control  was  substituted  for  the 
velocity  control.  The  operator  was  again  to  a]ign  the  real  time  vehicle 
with  the  real  time  road,  and  was  presented  with  the  real  time  road  and 
the  delayed  vehicle  feedback.  Both  subjects  wc^re  used.  Fewer  speeds  and 
lags  were  used  as  trends  were  desired  rather  titan  complete  data. 


EXPERIMENTAL  RESULTS 


Twenty-eight  pages  of  experimental  results  follow  this  discussion. 

They  are  preceded  by  an  index  which  shows  the  order  in  iMch  they  are 
presented.  The  first  twenty  present  time-on- target  and  integrated-absolute- 
error  scores  for  both  subjects  and  all  three  modes  of  tracking.  The 
curves  on  the  first  ten  pages  are  drawn  through  the  approximate  mean  of 
the  experimental  points .  The  curves  on  the  next  ten  pages  are  drawn  with 
slightly  less  emphasis  on  each  set  of  points  and  slightly  more  on  obtaining 
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a  smooth  curve.  The  last  eight  pages  consist  of  the  charts  taken  from 
typical  runs.  Runs  with  extremely  good  performance  (low  speeds,  no  lag) 
and  iTuns  with  extremely  foul  performance  (high  speeds,  long  lags)  are  not 
included,  as  they  are  of  little  interest. 

These  charts  are  included  because  the  puipose  of  this  experimentation 
was  to  gain  knowledge  about  a  subject's  ability  to  drive  a  vehicle. 

Good  time-on-target  and  error  scores  are  not  sufficient,  since  good  scores 
can  resiat  from  an  excellent  perfomnance  99  percent  of  the  time  and  a  delta 
function  of  error  in  the  remainder.  One  single  surge  of  error,  even 

D  though  so  short  in  time  that  it  does  not  integrate  to  much,  can  q\iite 

1  effectively  wreck  a  vehicle.  The  charts  give  an  indication  of  the  distri- 

2  button  of  the  scored  quantities . 

1 

I  The  target  zone  was  represented  ly  a  display  distance  of  3/l^'ths  of 

an  inch  centered  about  the  problem.  As  long  as  the  controlled  quantity 
TOS  in  this  zone,  it  was  considered  to  be  on  target.  The  approximate 
width  of  this  zone  on  the  charts  is  shown  at  the  top  of  each  chart  page. 
Also  shown  on  the  chart  pages  is  the  rate  of  chart  travel  per  second . 

^en  a  run  was  not  considered  to  be  of  sufficient  interest  to  warrant  the 
inclusion  of  the  entire  run,  only  one  strip  appears  on  the  page.  This 
represents  1-1/2  minutes,  or  half  of  the  scored  period.  If  two  strips  are 
shown,  the  entire  scored  period  is  represented. 

Error  scores  are  unitless,  since  the  scores  are  of  relati.ve  value 
only.  The  errors  were  read  from  the  computer  in  volts,  but  these  units 
are,  of  course,  meaningless.  In  order  to  gain  some  feeling  for  error,  a 
constant  error  of  l/2  inch  on  the  scope  face  represented  approximately 
0.8  major  divisions  on  the  chart  paper  and  integrated  to  72  over  a  three- 
minute  period.  As  a  further  indication  of  score  value,  if  the  control 
was  centered  with  the  controlled  q-uantity  stationary  in  the  center  of 
the  scope  face  and  a  nui  made  without  the  operator,  the  time  on  target 
was  approximately  ten  percent  and  the  error  about  sixty-five. 

Some  comments  are  in  order  about  learning,  which  is  an  xmavoidable 
variable  in  experiments  including  a  human  operator.  In  these  experiments 
it  was  desired  to  approximate  "fully  trained"  performance.  In  other  words, 
ary  performance  degradation  should  ideally  be  due  to  the  speed  and  lag 
parameters,  rather  than  lack  of  operator  training.  It  was  therefore 
necessary  to  develop  a  method  of  ascertaining  when  such  a  "fully  trained" 
state  had  been  reached. 

At  the  beginning  of  the  experimental  program,  each  operator  was  given 
a  series  of  runs  in  order  to  familiarize  him  with  the  apparatus,  the  dis¬ 
play,  and  the  duties  expected  of  him.  Daring  these  indoctrination  runs, 
he  was  also  given  a  chance  to  try  different  tracking  techniques  and  choose 
the  one  \diich  he  considered  most  successful. 

After  the  operator  was  thoroughly  familiar  with  his  task,  the 
experimental  runs  were  started.  At  each  new  setting  of  time  lag  or 
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target  speed,  it  was  necessary  to  determine  the  point  at  vjhich  the  operator 
was  no  longer  being  influenced  to  any  appreciable  degree  by  further  fam¬ 
iliarization  with  the  new  values.  This  was  the  "fully  trained"  point. 

Two  methods  were  available  to  accomplish  this.  One  was  operator 
opinion;  the  other  was  the  opinion  of  the  expejdmenter.  After  a  few  hours 
experience  with  the  apparatus,  the  operator  could  tell  quite  acc\irately 
when  he  had  learned  to  control  any  particular  speed-lag  situation  to  the 
best  of  his  ability.  Ey  observing  the  real  tine  error,  time-on- target, 
and  integrated  error  scores,  the  experimenter  could  also  ascertain  when 
familiarization  was  complete.  Depending  upon  the  difficulty  of  the  task, 
this  point  tjas  reached  in  periods  of  tracking  time  ranging  from  five 
minutes  to  one-half  hour. 

After  the  operator  and  the  experimenter  agreed  that  steady  state 
operation  had  been  reached,  txjo  runs  were  made.  If  these  runs  agreed 
quite  closely,  the  assumption  vias  made  that  the  learning  period  was 
completed.  If  the  second  run  xvas  higher  than  the  fiirst,  it  vjas  assumed 
that  learning  had  not  yet  been  completed  and  the  process  was  continued 
until  a  plateau  was  reached.  If  the  second  run  was  lower  than  the  first, 
additional  runs  were  made  until  the  scoring  stiibilized.  The  scores 
achieved  after  the  operator  and  experimenter  agreed  that  familiarization 
was  complete  are  those  shown  plotted  in  the  dai:a  section. 

This  technique,  of  course,  did  not  guaranl-ee  that  the  end  of  the 
learning  process  had  been  reached.  For  one  reiison,  slow  improvement  was 
hard  to  recognize  because  of  the  scatter  xdiich  characterizes  data  frOTi  a 
system  containing  a  human.  However,  an  impractical  amount  of  experimenta¬ 
tion  time  would  have  been  necessaiy  in  order  to  perform  sufficient  tracking 
at  each  speed-lag  point  to  ensure  that  no  addi1,ional  learning  would  take 
place.  Long  series  of  runs  were  therefore  performed  at.  a  few  test  points 
to  check  for  possible  long  term  or  discontinuous  learning. 

At  the  beginning  of  experimentation  both  subjects  were  given  long 
series  of  runs  at  one-half  speed,  no  lag,  and  Velocity  Type  I  tracking. 
Eight  five  minute  runs  were  performed  xidth  five  minute  rest  periods 
between.  These  were  followed  by  a  continuous  thirty  minute  run.  After  a 
day’s  rest,  an  additional  four  runs  were  performed  at  the  same  test 
point.  Ho  improvement  was  noticeable  in  either  subject.  However,  after 
Subject  No.  1  had  gone  through  the  entire  Velocity  Type  I  and  Velocity 
Type  II  programs  he  repeated  the  one-half  speed,  no  lag.  Velocity  Type  I 
test  point  and  achieved  a  time  on  target  score  five  percent  higher  and  an 
error  two  units  lovrer. 

Subject  Ho.  II  ^^as  not  retested  at  the  above  point.  However,  he  was 
tested  at  one-half  speed  and  no  lag  at  the  beginning  and  at  the  end  of  the 
acceleration  control  program  and  no  improvement  was  noticed.  After  the 
entire  experimental  program  had  been  concluded.  Subject  No.  1  was  given  a 
seides  of  tests  at  one-fourth  speed  and  three  seconds  lag  with  Velocity 
Type  I  control.  After  a  total  of  one  and  one-half  hoxirs  tracking  time  at 
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this  point,  he  had  improved  his  previous  time  on  target  score  bj'"  seven 
percent  and  lo^rered  his  previous  error  score  by  six  points. 

This  is  not  sufficient  data  on  learning  to  be  conclusive.  Hox-rever, 
it  does  appear  that  the  performance  of  Subject  No.  1  did  improve  slightly 
xgith  the  accumulation  of  many  hours  of  tracking  experience.  Subject  No.  2 
did  not  demonstrate  such  long  term  improvement.  However,  it  is  of  interest 
that  Subject  No.  2  ivas  consistently  a  slightly  better  tracker,  and  that 
Subject  No.  I’s  long  term  improvement  served  only  to  bring  his  performance 
up  to  the  level  of  that  of  Subject  No.  2.  A  difference  in  driving 
techniques  might  explain  the  difference  in  operator  learning.  Subject 
No.  1  might  use  methods  more  dependent  upon  the  nature  of  the  target  than 
Subject  No.  2.  Improvement  might  therefore  come  about  vjhen  Subject  No.  1 
had  tracked  long  enough  to  extract  additional  information  out  of  the  target 
vrave.  This  is  theoretically  possible,  since  the  target  is  composed  of 
four  sine  waves,  rather  than  being  completely  random.  Perhaps  after  long 
experience,  it  is  possible  to  achieve  a  greater  ability  to  predict  future 
target  motion. 

The  above-mentioned  "long  tern"  improvement  is  not  sufficient  to  in 
ar^y  vjay  invalidate  the  experimental  resiilts.  The  object  of  the  experimenta¬ 
tion  was  to  establish  trends  and  relationships  of  performance  rather 
than  absolute  performance  values .  The  method  used  to  establish  the  point 
at  which  the  operator  x-ras  considered  "fully  trained"  was  consistent 
throughout,  so  any  long  tem  improvement  woxild  elevate  the  performance 
curves  somexdiat,  but  disturb  their  character  and  relationship  to  a  much 
lesser  degree. 

A  few  of  the  curves  vrarrant  slight  additional  explanation.  The  first 
is  the  performance  of  Subject  No.  1  xm-th  Velocity  T^e  I  control  and  l/4 
second  time  lag.  The  scores  xrere  little  better  (and  sometimes  xrorse)  than 
the  scores  achieved  x/ith  l/2  second  delay  in  the  corresponding  sitxiation. 
Both  siibjects  initially  had  trouble  with  the  l/4  second  lag,  althoxigh 
Subject  No.  2  eventually  overcame  the  difficxaty.  The  reason  is  that  a 
human  mind  has  difficulty  in  identifying  a  time  period  as  short  as  1/4 
second.  This  lag,  therefore,  does  not  have  a  definite  qxjality  as  do 
longer  lags.  The  control  seems  instead  to  merely  be  very  sluggish  and  the 
operator  tends  to  overcompensate.  In  many  situations,  this  proved  a 
more  difficult  situation  for  Operator  No.  1  to  handle  than  a  lag  of  l/2 
second,  which  although  t'wice  as  long,  is  easily  Identifiable. 

Subject  No.  1  did  not  choose  to  use  the  detent  xmtil  a  lag  of  three 
seconds  had  been  reached.  At  shorter  time  lags  he  had  preferred  to  rely 
upon  the  spring  loading  of  the  knob.  Hoxrever,  at  a  lag  as  long  as  three 
seconds  it  became  quite  important  to  knov;  the  null  point  of  the  control 
knob  to  a  greater  accxiracy  than  spiing  centering  vrould  allot;.  This  may 
explain  xdiy  the  time-on-target  scores  for  certain  portions  of  the  three- 
second-delay  Velocity- lype-I  run  are  as  good  as  those  for  two  seconds  of 
delay.  The  detent  cannot  definitely  be  called  the  reason,  hovrever,  since 
the  error  scores  do  not  shot;  this  same  character.  Operator  No.  2  xised  the 
detent  for  the  entire  program. 
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During  the  l/l6th,  l/8th,  l/4th,  l/2  spetd  runs  vjith  2  seconds  of  time 
lag.  Velocity  Type  I  control,  and  Subject  No,  2,  the  nrnnber  three  resolver 
•was  not  functioning  in  the  problem  genera-tor.  The  svibject  \ja.s  therefore 
tracking  the  sum  of  three  sine  •waves  instead  of  •the  sum  of  four.  This 
could  explain  xdiy  his  low  speed  scores  were  better  than  might  be  expected. 

The  charts  on  pages  D21-.D28  show  •that  the  error  is  in  general  quite 
uniformly  distributed  in  time.  In  all  cases  perfect  tracking  •vrould  result 
in  'the  dotted  line  lying  exactly  on  the  solid  line.  Up  •to  a  certain 
point,  the  charts  for  Velocity  Type  I  and  acctderation  tracking  show  that 
the  siibject  quali^tatively  made  •the  proper  control  movements.  The  errors 
•were  quantitative,  in  •that  the  subject  turned  too  much  or  too  little.  For 
•these  runs  the  solid  line  represents  the  tai^et  in  real  time  and  the  dotted 
line  represents  the  controlled  quantity  in  real  time. 

As  an  example  of  Velocity  Type  I  tracking,  see  'the  l/4  speed  ms  at 
•the  bottom  of  page  D-23,  A  good  example  of  acceleration  tracld.ng  can  be 
seen  at  -the  bottom  of  page  D-24,  The  curves  are  similar  in  character, 
except  that  acceleration  control  results  in  larger  errors  due  to  the 
increased  burden,  it  places  upon  the  operator.  In  bo^th  cases  the  operator’s 
control  movements  lag  the  problem  moveraen^ts  orJy  •the  approximate 
magnitude  of  the  operator’s  reaction  time  (l/4  second  or  more,  depending 
upon  •the  coraplexi^ty  of  the  decisions  involved)  .  This  is  vdiat  would  be 
expected  from  the  experiments,  since  the  operator  was  presented  •tri.th  the 
•target  in  real  time  and  his  position  in  delayed  time.  He  could  therefore 
"s'teer"  xd.th  •the  -target,  but  could  not  check  Ids  success  until  his  feed¬ 
back  arrived  after  the  time  delay. 

VflL-th  Type  H  velocity  control,  resul-ts  were  qiii^te  different.  A  good 
example  appears  at  the  top  of  page  D-24,  In  Ihis  case,  the  solid  line 
represen-ts  the  problem  position  and  the  dotted  line  represen-ts  "the  delayed 
controlled  quantity  position.  Because  of  the  time  lag  in  the  control, 
the  operator  vrould  move  when  the  problem  moved,  but  the  "follower"  vrould 
not  move  until  the  time  lag  had  elapsed.  Therefore,  as  expected,  the 
follower  lagged  the  problem  by  "the  time  delay  plus  "the  i^ction  time  of 
the  operator  plus  any  additional  hesi-tancy  whi  ch  was  introduced  by  -the 
difficulty  of  the  -task. 

The  controlled  quantity  path  vjas  not  a  perfect  replica  of  the  problem 
pa-th,  except  for  being  displaced  in  time,  because  -the  operator  attempted 
to  outwit  the  system.  Knowing  the  delay  existed  in  his  control,  he  would 
overcontrol  in  order  -to  catch  up  wi'th  -the  problem,  and  then  attempt  to 
stop  before  -the  problem  stopped  in  order  not  -l^  overshoot.  This  became 
very  pronounced  in  the  six  second  delay,  l/4  speed  run  on  page  D-94,  The 
subject  not  only  overcontrolled  (note  much  sharper  slopes  on  controlled 
quantity  than  on  problem),  but  he  also  waited  until  he  had  an  indication 
of  what  -the  problem  might  do  before  he  moved  the  control.  Instead  of 
matching  the  problem,  he  therefore  drove  in  a  series  of  s-teps,  idiich 
matched  only  -the  problem  extremes. 
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At  some  point  or  increasing  time  lag  and  target  speed,  a  marked 
instability  became  noticeable.  Examples  are  the  top  chart  on  page  D-26 
(1/2  speed,  3  seconds  lag,  velocity  “^ype  H  control),  and  the  center 
portion  of  the  third  chart  from  the  bottom  of  page  D-26  (I/2  speed,  3 
seconds  lag,  acceleration  control).  The  controlled  quantity  xjas  out  of 
phase  by  almost  180  ■with  the  problem.  This  represents  an  absolutely  out 
of  control  situation,  and,  of  course,  is  far  beyond  the  bounds  of  interest 
for  vehicle  control. 

In  order  to  use  this  experimental  data  to  provide  infoimation 

D  applicable  to  a  specific  control  situation,  such  as  control  of  a  lunar 

1  vehicle,  it  is  necessary  to  define  acceptable  performance.  Some  minimum 

2  acceptable  time- on- target  score  and  some  maximum  permissible  error  must  be 

1  chosen  using  the  charts  on  pages  11-21—11-^  as  an  indication  of  control 

I  precision.  Once  this  is  done,  the  first  20  pages  of  curves  give  a  rapid 

indication  of  the  effect  of  the  independent  variables  on  performance. 

Vflien  using  these  curves  it  should  be  kept  in  mind  that  low  time-on- 
target  scores  are  rather  meaningless,  since  time— on- target  can  never 
become  less  than  zero  and  the  curves  become  as3/mptotic  in  nature  no  matter 
how  uncontrolled  the  performance.  Similarly,  error  curves  become  asymptotic 
at  very  high  values  since  the  target  always  r<anained  upon  the  scope  face. 

The  asymptotic  nature  of  the  time-on- target  scores  is  very  apparent,  since 
the  minimum  value  is  mthin  the  ordinate  range.  The  error  curves  are  not 
so  clearly  asymptotic,  since  the  ordinate  includes  error  scores  only  up 
to  70,  whereas  an  average  error  of  I/2  of  the  useable  scope  face  would  have 
resulted  in  an  error  of  approximately  3OO. 

Althpxigh  as  mentioned  previously,  it  is  not  the  purpose  of  this 
report  to  derive  moon-mobile  design  criteria,  it  is  wojrthwhile  to  examine 
briefly  the  experimental  data  at  the  earth-moon  lag  time  as  an  example 
of  the  use  of  the  curves.  As  a  starting  point,  let  us  assume  that  neither 
time-on-target  scores  below  50  percent  nor  error  scores  in  excess  of  15  sre 
acceptable.  This  assumption  should,  of  course,  be  based  upon  the  terrain 
to  be  traversed.  Obviously  a  different  degre  of  precision  is  going  to  be 
required  to  drive  through  a  narrow  canyon  idiich  t\mis  every  30  feet  than 
to  merely  dodge  obstacles  placed  30  feet  apart,  Hoi-jever,  at  this  point 
nothing  is  knoim  of  the  nature  of  the  terrain.  Scores  of  50  percent  on- 
target  and  15  error  represent  a  reasonable  starting  point,  since  an 
examination  of  pages  D-21-IJ-28  show  that  any  scores  worse  than  these 
resulted  from  a  performance  vjhich  would  in  all  probability  have  been 
inadequate  for  vehicle  control. 

The  curves  on  pages  D-1  to  D-20  are  quite  linear  within  this  region 
of  acceptability.  The  most  notable  exception  to  this  linearity  occurs  in 
the  region  of  low  (below  l/l6th)  target  speed  on  pages  D-1  to  D-10. 

Althou^  data  trais  not  taken  at  these  speeds,  it  appears  that  the  curves 
bend  rather  sharply  into  the  100  percent  on^- target  and  0  error  points. 

This  is  reasonable,  since  at  very  small  target  speeds  the  operator  should 
be  able  to  continually  remain  on  target  due  to  the  fact  that  target  motion 
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during  the  time  lag  would  be  so  small.  Time- on- target  scores  plotted 
against  target  speed  should  therefore  leave  the  100  percent  point  xd.th  a 
very  small  slope.  On  the  other  hand,  as  soon  as  the  operator  must  move 
the  knob,  he  accrues  a  small  amount  of  error  due  to  stick-slip  friction 
and  in^jorfections  in  his  manual  movements.  Error  plotted  against  target 
speed  therefore  climbs  rapidly  to  some  small  value  and  then  begins  its 
characteristic  increase. 

Th©  effect  of  an  earth-moon  time  lag  (approximately  2-l/2  seconds)  on 
these  experiments  can  be  seen  on  pages  D-11  toD-20.  Considering  first 
the  time- on- target  limitation,  page  Dul2  shows  the  effect  of  the  lag  upon 
the  runs  with  velocity  l^pe  I  control.  I(fi.th  no  lag  the  full  target  speed 
could  be  acceptably  followed.  Vfi.th  2-1/2  seconds  lag,  the  "controllable" 
target  speed  was  slightly  less  than  l/4  speed.  Page  D-13  shoxvs  the  same 
information  for  the  velocity  lype  H  control.  With  no  lag,  full  speed 
could  again  be  controlled.  With  2-1/2  seconds  lag,  permissible  speed  was 
approximately  l/8  as  high.  Page  D-15  presents  the  effect  upon  accelera¬ 
tion  control.  In  this  case  only  l/2  speed  could  be  controlled  with  no 
lag.  Vfi.th  a  a-l/2  second  lag,  the  maximum  controllable  speed  was  l/8 
speed. 

Considering  the  error  limitation,  page  D-17  shows  that  the  lag 
reduced  the  ? controllable"  speed  from  full  to  slightly  less  than  1/4 
speed  Tjith  velocity  Type  I  control.  VB-th  velocity  Type  II  control  (page 
D-18)  the  speed  was  reduced  from  slightly  under  full  to  l/8  speed.  With 
acceleration  control  (page  IU20)  speed  was  r«iluced  from  l/2  speed  to  l/8 
speed. 

In  order  to  investigate  the  effects  of  a  tighter  performance 
requirement,  let  us  now  assume  that  neither  time-on- target  scores  belox^ 

80  percent  nor  error  scores  in  excess  of  5  acceptable.  Considering 
first  the  time-on-target  criteria,  a  time  lag  increase  of  fnmi  zero  to 
2.5  seconds  required  a  speed  reduction  of  frow  l/2  speed  to  betxjeen  l/8 
and  l/l6th  speed  for  the  velocity  lype  I  control,  from  l/2  speed  to  l/l(?th 
speed  for  velocity  Type  II,  and  from  l/4  speed  to  much  less  than  l/l6th 
speed  for  acceleration  control. 

Because  of  the  error  limitation,  the  increased  time  lag  lovrered  the 
maximum  permissible  speed  from  l/2  speed  to  between  l/l6th  and  l/8th 
speed  for  velocity  Type  I  control,  frcmi  l/2  s]>eed  to  l/l6th  speed  for 
velocity  Type  H  control,  and  from  l/4  speed  io  much  less  than  l/l6th 
speed  for  acceieration  control. 

Several  comments  result  from  this  prellmilnaiy  investigation  of  the 
curves,  ^n  example  of  the  looser  perfonnance  limitation  is  the  l/4 
speed,  3  second  lag,  velocity  control  Type  I  chart  on  page  D-23,  An 
exanQjle  of  the  tighter  is  the  l/l6th  speed,  3  second  lag,  velocity  Type  H 
run  on  page  D-21.  The  tlme-on- target  to  error  score  relationships  of 
5O-I5  and  80-5  were  chosen .because  they  seemed  to  typify  corresponding 
scores. 
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The  first  point  of  interest  is  that  the  time-on-target  and  the  error 
limitations  give  very  similar  results.  Since  the  curves  are  quite  linear 
in  the  region  of  interest,  it  can  be  concluded  that  both  time-on-target 
and  error  scores  are  valid  performance  measures,  as  long  as  the  markedly 
asymptotic  legions  of  the  curves  are  not  used. 

The  second  interesting  feature  is  the  similarity  of  the  lag  effect  at 
the  two  performance  levels .  In  both  cases  with  no  lag  the  maximum  speed 
"controllable"  with  velocity  Type  I  and  velocity  lype  II  controls  (which 
are  identical  at  no  lag)  was  roughly  twice  that  "controllable"  with  the 
acceleration  control.  Acceptable  speeds  were  approximately  twice  as  high 
at  the  lower  performance  limit  than  at  the  tighter  limit. 

Performance  decay  due  to  the  lag  was  slightly  more  serious  in  the 
case  of  the  more  severe  limitation,  Vfl.th  this  criteria,  maximum 
acceptable  speed  with  velocity  Type  I  control  was  reduced  to  between  l/8 
and  l/4  of  its  no  lag  value,  with  velocity  Type  II  to  l/8  of  its  no  lag 
value,  and  with  acceleration,  control  to  less  than  l/4  of  its  no  lag  value. 
'Vfi.th  the  lower  limitation,  maximum  permissible  speed  with  velocity  Type  I 
control  was  resiuced  to  slightly  less  than  l/4  of  its  no  lag  va^ue,  with 
velocity  Type  II  to  l/8  of  its  no  lag  value,  and  with  acceleration  control 
to  approximately  l/4  of  its  no  lag  value. 

Another  interesting  point  is  the  close  similarity  of  velocity  Type  I 
controlled  runs  at  l/8,  l/4,  and  l/2  speed  with  acceleration  controlled 
runs  at  l/l6th,  l/8th,  and  l/4th  speed,  respectively,  at  all  experimental 
time  lags.  As  speeds  increased  above  this  point,  the  relationship  lessened. 
Full  speed  runs  with  velocity  Type  I  control  are  quite  svqperior  to  l/2 
speed  z'uns  with  acceleration  control  because  of  the  cumulative  confusion 
due  to  the  acceleration  control  at  higher  speeds.  However,  in  general 
the  character  of  the  acceleration  curves  is  quite  similar  to  that  of  the 
velocity  Type  I  cui^es, 

A  very  gross  relationship  between  target  speed  and  vehicle  ground 
speed  can  be  attained  by  considering  only  the  highest  frequency  sine  wave 
in  the  target  function.  This  wave  has  a  frequency  of  1^?  cycles  per  minute 
at  full  target  speed  and  shows  up  as  the  shortest  duration  "wiggle"  in 
the  target  function.  A  vehicle  traveling  10  miles  per  hour  travels  880 
feet  in  a  minute.  If  the  vehicle  were  travelling  in  a  sinusoidal  path,  a 
frequency  of  l6  cycles  per  minute  woiold  be  equivalent  to  one  cycle  every 
55  feet.  Full  target  speed,  therefore,  corresponds  roughly  to  a  vehicle 
speed  of  10  miles  per  hour  over  terrain  containing  obstacles  30  feet  apart 
(two  per  cycle). 

The  vehicle  to  be  used  in  the  Phase  II  experiments  at  Stanford  has 
small  inertias  and  simple  dynamics.  Assuming  that  it  will  be  driven  over 
a  course  which  requires  a  degree  of  control  similar  to  that  discussed  in 
this  section  and  that  the  course  contains  obstacles  on  the  average  of  15 
feet  apart,  the  author  is  expecting  a  maximum  no-lag  speed  of  from  2il/2 
to  5  miles  per  hour  and  a  maximum  speed  with  2-1/2  seconds  lag  of  someidiere 
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between  1/4  and  l/8  of  the  no-lag  speed.  Less  severe  control  requirements 
and  less  complex  courses  will,  of  course,  allow  hi^er  speeds.  More 
ccMnplicated  control- vehicle  d^amics  and  higher  inertias  iivill  correspond¬ 
ingly  reduce  maximum  allo^^able  speed. 


Stanford  Uni  vers  Ity, 

Stanford,  Calif.,  Roveaaiber  2,  I96I. 
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